Wherefore, having thus described the present invention, what is claimed 

is: 

1. A computer-implemented process for face recognition, comprising using 
5 a computer to perform the following process actions: 

inputting an image of a face of a subject sought to be recognized having a 
practicular face pose; 

inputting a generic three dimensional face model; 
creating a specific three dimensional face model of the specific subject 
10 sought to be recognized by deforming the generic face model to conform to the 
shape of the face depicted in the input image; 

synthesizing various face pose images using the specific 3-D face model; 

and 

employing the synthesized images as training images to train a recognizer. 

15 

2. The computer-implemented process of Claim 1 further comprising the 
process action of using a spline surface construction technique to smooth the 
specific face model. 

20 3. The computer-implemented process of Claim 2 further comprising the 

process action of using a texture mapping technique to endow textural detail to the 
smoothed face model. 
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4. The computer-implemented process of Claim 1 wherein the process 
action for inputting an image of a face comprises inputting one frontal view and one 
profile view of the face. 

5 5. The computer-implemented process of Claim 1 wherein the process 

action for inputting an image comprises inputting at least two views of a face each 
having poses varying in orientation from the others by at least 15 degrees. 

6. The computer-implemented process of Claim 1 wherein the process 
10 action for inputting a generic three dimensional face model comprises employing a 

polygon model that depicts the surfaces of the face as a series of vertices defining 
a facial mesh. 

7. The computer-implemented process of Claim 6 wherein the process 
15 action for creating a specific three dimensional face model of the subject 

comprising using a deformation technique to create a specific three dimensional 
model of the subject from the generic model and the input images. 

8. The computer-implemented process of Claim 7 wherein the process 
20 action of using a deformation technique to create a specific three dimensional 

model further comprises the process actions of: 

extracting feature point sets from input frontal and profile images of 
the subject; and 
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modifying the generic face model to the specific face model by 
comparison and mapping between the feature point sets. 

9. The computer-implemented process of Claim 4 wherein symmetry of 
5 the face is assumed, such that for the purposes of said creating of a specific 3-D 

face model it is assumed the side of the face opposite that depicted in the profile 
image has the same shape and coloring. 

1 0. The computer-implemented process of Claim 1 wherein two or more 
10 images are used to create the model of a specific face, further comprising a 

process action of refining the specific model of the face by using additional images. 

1 1 . The computer-implemented process of Claim 2 wherein the facet- 
based representation of the specific face is replaced with a spline surface 

15 representation. 

12. The computer-implemented process of Claim 3 wherein the process 
action to endow textural detail to the face model further comprises the process 
action of using the input images to assign color intensity to each pixel of the three 

20 dimensional face model. 

13. The computer-implemented process of Claim 12 wherein a Bezier 
patch technique is employed to add texture detail to a face model. 
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14. The computer-implemented process of Claim 13 wherein the process 
action for assigning color intensity further comprises the process action of: 

for each Bezier surface patch of the face surface determining a 
corresponding texture patch by mapping the boundary curve of the Bezier patch to 
5 the face image. 

15. The computer-implemented process of Claim 13 wherein both frontal 
and profile images are employed and wherein the face image chosen to provide the 
texture information depends on the preferred direction of the Bezier patch; such 

10 that the frontal image is used to map when the angle between the direction and the 
Y-Z plane is less than 30 degrees and wherein a profile image is used when the 
angle between the direction and the Y-Z plane is greater than 30 degrees. 

16. The computer-implemented process of Claim 1 wherein face pose 
15 images are synthesized for every in-plane rotation of plus or minus 10 to 15 

degrees and every out-of-plane rotation of plus or minus 15-20 degrees, with 
increments of about 3-7 degrees within a group. 

17. The computer-implemented process of Claim 1 wherein the 

20 illumination is varied to produce the synthetic images at varied illuminations by 
taking the generated images and synthetically varying the illumination to produce 
each image at various illuminations. 
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18. A system for generating synthesized face images, the system 
comprising: 

at least one camera positioned so capture at least one image of a 
subject for whom images are to be synthesized; 
5 a general purpose computing device; and 

a computer program comprising program modules executable by the 
computing device, wherein the computing device is directed by the program 
modules of the computer program to, 

input at least one image of a face of a subject from the at least 

10 one camera; 

input a generic face model; 

create a specific face model of the subject by deforming the 
generic face model to conform to the shape of the face depicted in the input image; 
and 

15 synthesize various face poses using the specific 3-D face 

model. 



19. The system of Claim 18, further comprising a computer module to, 

employ the synthesized images as training images by inputting 
20 the synthesized images into a recognizer. 

21 . The system of Claim 1 8, further comprising a computer module to, 
use a spline surface technique to smooth the specific face 

model. 
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22. The system of Claim 21 , further comprising a computer module to, 

use a texture mapping technique to endow textural detail to the 
smoothed face model. 



5 23. A computer-readable medium having computer-executable 

instructions for generating synthesized images of a face, said computer-executable 
instructions comprising: 

inputting an image of a face of a subject having a practicular face pose; 
inputting a generic three dimensional face model; 
10 creating a specific three dimensional face model of the specific subject by 

deforming the generic face model to conform to the shape of the face depicted in 
the input image; 

using a spline surface construction technique to smooth the specific face 

model; 

15 using a texture mapping technique to endow textural detail to the smoothed 

face model; 

synthesizing various face pose images using the specific 3-D face model; 

and 

employing the synthesized images as training images to train a recognizer. 
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